Skip to content

Comments

Add GitHub Action to build and run LLM runner with custom text prompt#16585

Draft
Copilot wants to merge 2 commits intomainfrom
copilot/add-gh-action-llm-runner
Draft

Add GitHub Action to build and run LLM runner with custom text prompt#16585
Copilot wants to merge 2 commits intomainfrom
copilot/add-gh-action-llm-runner

Conversation

Copy link
Contributor

Copilot AI commented Jan 14, 2026 •
edited
Loading

Summary

Adds a workflow_dispatch GitHub Action that builds the LLM runner and executes it with a user-provided text prompt.

Workflow inputs:

  • prompt - Input text (default: "Once")
  • seq_len - Max sequence length (default: 30)
  • temperature - Sampling temperature (default: 0)

Pipeline:

  1. Setup ExecuTorch + LLM requirements
  2. Download stories110M model + tokenizer
  3. Export to .pte with XNNPACK backend
  4. Build llama runner via CMake
  5. Run inference with user prompt
  6. Display output in workflow logs

Uses existing CI infrastructure (executorch-ubuntu-22.04-clang12 image) and follows patterns from test-llama-runner-linux.

Test plan

  • YAML syntax validated with Python yaml parser
  • Workflow structure follows existing pull.yml patterns for LLM runner jobs
  • Manual trigger available via Actions tab → "llm-runner-demo" → "Run workflow"
Original prompt

Can we add a GH action to build a llm runner and given some input, run the input text prompt?

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

@pytorch-bot
Copy link

pytorch-bot bot commented Jan 14, 2026 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/16585

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 14, 2026
@github-actions
Copy link

github-actions bot commented Jan 14, 2026

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

@kirklandsign
Add GitHub Action workflow to build and run LLM runner with custom te…
052f3aa 
…xt prompt

Co-authored-by: kirklandsign <107070759+kirklandsign@users.noreply.github.com>
Copilot AI changed the title [WIP] Add GitHub action to build LLM runner for input prompts Add GitHub Action to build and run LLM runner with custom text prompt Jan 14, 2026
Copilot AI requested a review from kirklandsign January 14, 2026 20:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@kirklandsign kirklandsign Awaiting requested review from kirklandsign

At least 1 approving review is required to merge this pull request.

Assignees

@kirklandsign kirklandsign

Copilot code review Copilot

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@kirklandsign